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BACKGROUND OF THE INVENTION 
Typical display screens occupy a relatively small par. of a viewer's, or user's, 
field of view. A standard computer monitor, televfsion screen, liquid crystal, flat panel, 
tnin-film transistor, or other type of display device might measure 14 to 29 inches 
diagonal. This requires a user to be relatively close to the display in order for the 
display to fill up a larger portion of the users field of view. 

Larger displays are possible. For example, a projection display can occupy a 
much larger area. However, such devices are often expensive and inconvenient For 
example, a projector might have to be located a. some distance from the screen* 
other surface, in order to create a sufficiency large display. Another problem w* 
projection type of displays is .ha. they, in effect, 'blow up" a hfch resolution into a 
coarser resolution. For example, if a 1024 x 768 display is projected .o create a large 
image, the image is still a, fine 1 024 x 768 resolution. The picture elements or pixels, 
and spaces between pixels are made larger by projecfing. Thus, the pixel densrty ,s 
deceased. This is why projected displays are usually viewed from a larger MM. 
than the display screens mentioned above. A longer viewing dis.ance means mat fine 
coarser resolution is not as noticeable. 

Another approach is a so-called "wall of video". This approach uses mulbple 
display screens usually arranged in a rectangle, or wall. Porfions of an image to be 
displayed are divided among .he separate display screens in fire wall so ,ha, a much 
iarger display can be obtained. Note IhaUhis approach maintains me display density 
since each screen is still displaying a. Ks nafive density. For example, if three screens 
are used in a now, and each screen has a 1024 x 768 denary, .hen although three 
times as much area is covered by the combination of three display screens, there are 
also three times as many pixels in the composite display. 

A problem with the wall of video approach is that r. is inflexible and expensive. 
The system must be designed from me outset so mat an image source can 
appropriately generate separate video signals to each of .he screens. Typical*, a 



computer is used to divide a single input image into separate images fo, the sections of 
t be wall of video. For example, if a wall of video uses 9 screens in a 3x3 arrangement, 
then the computer system is designed to divide an original image into an equal 3x3 
grid Each section of the grid is sent to the associated display screen. The 

arrangement is hardwired and is typically designed on a customized, per installabon, 
basis. Setting up such a display requires planning of the area to be covered, size and 
number of screens to use, multiple display output hardware devices, rxistom sottware 

to divide the input images, etc. 

Once a wall of video system is set up it is not easily changed. This makes rt 
difficult to adapt .he display to different applications. For example, viewing a mov,e 
may require that the screens be arranged in a 4:3 aspect ratio for best vowing. 
Present documents or tables of information might best be achieved if an overall 
display is taller than it is wide. Playing computer games that simulate immersion into a 
simulated environment warrant a display area that wraps around a user and that can 
potentially cover large spherical sections around the user. 

Thus, ft is desirable to provide a mufti-soreen display system that rmproves upon 
one or more of the shortcomings of the prior art. 

SUMMARY OF THE INVENTION 
The present invention allows a user to arbftrarily position display screens so that 
a larger field of view can be presented by a computer system that senses the screen 
P os«ons and provides appropriate display information. This is in contrast to the typical 
use of display screens wltere a single display screen is used and the posibon of . e 
display screen is assumed to be directly in front of a user's viewpoint. For example, 
two screens can be placed side-by-side so that their viewing surfaces together form a 
regular plane. This can be useful for viewing movies or oftter presentations IM 
benefit from a larger horizontal viewing field. More complex arrangements of muftrple 
screens can be set up for more immersive presentations such as virtual reality, 
simulations, computer games, etc. 

A mourning bracket for holding screen in a fixed orientate wfth respect to each 




other is described. A preyed embodiment o, ft. bracKe. inciudes a visua, indicator 
for determining the angle of a screen wfih respect to another. 

,„ one embodiment the invention provides a method for generating dtsplay 
inflation including determining the positions o, mulfiple dispiay screens and 
Generating display information for me display screens by using the detemmned 

^tanCher embodiment the invention provides a method for using multiple 
displa sins in a present, comprising firs, sensing the positions of a plural,«y of 
2S s-ns a, a firs, time; providing me firs, sensed positions to a dig., processor 
or Ling views for the pluralKy o, display sc re ens in accordance tfh the fits. 

te and providing the second sensed pos^ns to a digfcl processor o, rendenng 
views for the pluraltty of display screens in accordance wKh the second sensed 

P0SM T another embodiment the invention provides a method for using muKple 

display screens in a computer-generated presentation, comprising indicating to a 

II user prefened posifions for b»o or more display so, eens; an — v«ws 

,o, the two or more display screens in accordance with the preferred posrtions. 

ranotherembodimenttheinvenfionprovidesabracKetforioining^oormo. 

display screens, the bracket comprising a M slot for receding a firstdisplay screen; 
and a second slot coupled to the firs, slot for receding a second display screen. 

BRIEF DESCRIPTION OF THE DRAWINGS 
Fio 1A shows a user viewing multiple screens; 

Fig. 1 B is a left-side, perspecfive view the, includes some of me screens shown 
F ' 9 ' Fig. 2A is a first illustration of a processing system in communication wfth 



multiple display screens; 




Fig. 2B is a 



second illustration of a processing system in communication with 

multiple display screens; 

Fig. 2C is a third illustration of a processing system in commun.cat.on w.th 

multiple display screens; 

Fig. 3A is a first illustration to show use of mounting brackets for pos,t,on.ng a 

four-screen display; 

Fig. 3B is a second illustration to show use of mounting brackets for positomng 

a four-screen display; 

Fig 4A shows a bracket used to hold screen displays; 

Fig. 4B is a larger, perspective vtew of one of the brackets of Fig. 4A; and 

Fig. 4C illustrates the alignment pointer feature of a bracket. 



DETAILED DESCRIPTION OF A PREFERRED EMBODIMENT 
The present invention allows a use, to arbitrarily position display screens so that 
a larger field of vtew can be presented by a computer system that sense* .he screen 
positions and provkfes appropriate display information. This is in contrast to thence, 
usa of display screens where a single display screen is used and .he positron of ffre 
display screen is assumed to be directly in front of a user's viewpoint. For example, 
*o screens can be placed side-by-side so that their viewing surfaces together form a 
r ectangufcr plane. This can be useful for vowing movfcs or other 
benefit from a larger horizontal viewing ML More complex arrangements of muluple 
screens can be set up for more presentations such as virtual reality simulations, 

computer games, etc. 

In Fig 1A user 102 is in front of main screen 104. Screens 106 and 108 are 
p,aced adjacent to main screen 104 to the left and right sides, respectively. Screen 
110 b above main screen 104 and is angled towards the user. Augmenting screens 
112 and 116 are positioned behind and above the screens already mentioned. 

Screens such as 1 12 may include obscured screen areas such as at 1 14 if 
screens overlap. Obscured areas can be calculated by a program or programs that are 
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used to calculate, tender, generate or otherwise present a visual scene, or 
pre sen«a.ion, on the muKple display screens. In other words, since 
software is informad of the postas of the display saeens, the software can determme 
that the area at 1 14 of display screen 1 12 can not be seen by a user a. 102. In tm 
case the software can om« calculation for, and transfer of, viewing information to 
screen 112. 

in Fig 1A saeens are shown with borders such as border 120 on screen 108. 
Borders are portions of a display enclosure ma. are no. used to present informal. 
Borders are no. desirable for multiple screen presentation because .hey detract from 
an integrated, or coherent, presentation by inducing "blind spots." When two 
screens with borders are placed adjacently the border sfce grows as shown at 12 of 
Fig 1A in a preferred embodiment, me border size, shape and other characteristics (,. 
any) are conveyed to presentation software (i.e., software producing .he images to be 
vfcwed by a user) so that may can be taken into account in determining ***** 
sh ape posirion and orientation of display screens. Borders can be specified expWy 
or implicitly. BpU specification of borders includes a description of borders su* as 
their size and orientation. Implicit specfcation of borders assumes that borders east 
and ara of a known, or assumed, size and orientation wittr respect to detected or 

indicated screen positions. 

For example, if a user specifies display positions (not including border 
posirions, then the bonder pos«ions can be inferred as the spaces between the drsplay 
saeens. In this cas* no special accommodating of the borders is required. The 
presentation software merely counts .the border areas as "blank space" that does no. 
have screen coverage. If specffications are made for the posftions of screens and 
borders as a unit, as where monitor saeens are indicated coarsely by stating 
adjacencies of unfts and sizes of screens, then border sizes can be obfained or 
assumed in varying ways. One way is to have a database of dfcplay scaen types and 
provide for detection of display screen types and matching to the database wh,ch 
provides correspor*g border sizes. Or a typical border of, e.g., 1.5 inches can be 
assumed Or a user can indicate the presence of borders to the presentation software. 




Note that screens can be placed arbitrarily and anywhere. Display screen 1 16 
has been placed somewhat far behind and above the other display screens. In such a 
case, there may be a large amount of "blank space" or blank area between the 
screens In a preferred embodiment, the presentation software (e.g., a graph,cs 
program for rendering a scane) on* generates the portion of the scene that ,s 
appropriate for each display screen area based on the display screen's posihon and 
user wewpoint. The number, type, size or other characteristics of the display screens 
can vary from those discussed herein. 

Fig 1 B illustrates further aspects of display screen positioning. 

InFig IB.displayscreensareshownaswireframeswithoutbordersfor 

, , _ ci „ 1Bi . . ipfi. s ide Derspective view that includes some of 
simplification and clanty. Fig. 1B is a ten siae, peispw. 

,he screens shown in Fig. 1A. In Fig. 1B, user 102 faces main screen 104, side 
screens 106 and 108, and top screen 110, as in Fig. 1A. Displaced screen 116 ,s also 
shown Additional screens show the flexibiltty of the system by permitting floor screen 
130 rear screen 132 and wraparound screen 134. Such a configuration may be useful 
in immersive environments where the effect of the presentation is enhanced by 

providing images to a user's peripheral vision, or by allowing a user to look around at 
,he different display screens while still presented wfth relevant, coherent visual 

information. , , 

As used in this applicAn, "coherent- presentation of visual information inCudes 

presentation on two or more display devices where there is a perceived aesthetic 
consistency, or re la,ionship, of the visual infomtation on the different display dm» 
For exampie, a single scene that is Kndered across the multiple display devices at the 
same hme fits this description. Another example, is movement from one screen to 
another consistent with a simulate depiction or portrayal of natural, or phys,ca 
movement. An example of natural movement is a person walking, car moving, falling 

object, exploding object, ballistic path, etc. 

Screen posfflons can be predetermined, designated, or sensed. Sensing can 
include using remote sensing devices such as acoustic, radio-frequency, infrared, etc. 
For example, a user can indicate three points of a screen's perimeter by placing an 
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infrared emitter on each of the points. A computer system is informed of each point by, 
e g a user keypress at or near the time of emitter placing. Once three points, such as 
three corners of a display screen, are known, the three-dimensional position of the 
screen, along with the screen dimensions, can be determined. 

Three dimensional sensing can be by any means as is known in the art. For 
example, laser scanning, coordinate measuring machines, etc. can be used along w.th 
triangulation techniques to identify positions. Another approach is to use global 
positioning system (GPS) sensing. Other alternatives include angulation using phased 
antenna arrays, imaging using one or multiple cameras and scene analys.s, etc. 

Another type of sensing is mechanical sensing. This can use a movable arm 
located at a known point where the end of the arm is touched (or moved near) to one 
or more points of a screen. Joints or hinges can be affixed at places where screens 
are adjacent. Such joints can measure the angles made by the planes of the adjacent 
screens so that positions of secondary screens relative to a main screen can be 
determined This is usually sufficient to determine accurate positions of the secondary 
screens. Sizes of the screens can be manually input by the user so that presentat.on 
software can compute only the views, and viewport sizes, necessary to create 
information to be displayed on each of the screens. Such sensing joints can be made 
strong enough to hold and support multiple screens. An example of such a joint .s 
described, below. 

One useful way to determine positions of screens is simply to ask a user to input 
the positions. This manual position designating includes having a user make 
measurements of distances and angles which are then entered into a computer system 
that calculates the screen positions from the measurements. The user measurements 
can be rough approximations and screen positions can still be determined with enough 
accuracy to create a coherent multi-screen display. 

Screen positions can be calibrated. One form of calibration allows a user to 
move models of screens on a computer display. Each screen model corresponds to an 
actual screen that the user is viewing. The model positions are used to generate v.ews 
for the screens as the user is moving a model. When the user sees matching v.ews of 
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a scene, test pattern, reference object, etc.. among screens that include the model 
scraen being moved, then calibration is achieved. The user indicates to a computer 
system that me current model posttion resutts in a view that is coherent with another 
screen (e.g.. the main scraen) and the computer system can then use the information 
to generate further views for the screen corresponding to the model. 

Screen positions can be predetermined. For example, a presentation program 
may have defautt, or optimal, screen placements determined by a program, or 
presentation, author. In mis case, the user is directed to place the screens ,n a 
predetermined orientation. It is possible that an automated system can move the 
screens without user intervention. For example, screens can be on pivoting platforms. 

moveable robotic arms, etc. 

Figs. 2A-C illustrate different modes of information transfer to multiple d.splay 

screens . * 

|„ Fig 2A c omputersystem200includes3ou 6 ?uts202,204and206,matfeed 

scraens 212 214 and 216, respectively. Thus, the computer generates a separate 
output for each display screen. The outputs can be digital, compose or component 
video or any other type of format. Typically, a computer uses a graphics card that 
provides the image output. The computer can use multiple graphics cards or a angle 
graphics card can provide one o, more outputs. Other approaches to generating the 

output signals are possible. 

Fig 2B shows computer 200 using single output line 230 to feed information to 
all three screens 212. 214 and 216. In this case, each screen is "daisy chained' to the 
next screen. Each screen takes only the information appropriate for the particular 
screen. Many approaches can be used such as using a digital network (e.g.. Un,versal 
Synchronous Bus (USB), IEEE 1304, Ethernet, etc.) for the output line. Identifiers can 
be used to designate packets (or other portions of the signals) for a particular screen. 
,n general, any communications method can be used to transfer information from a 
computer executing a presentation program to the multiple display screens. 

Fig 2C illustrates wireless transfer of information from computer 200 to d,splay 
screens 212 214 and 216. Transmitter 240 sends signals (e.g.. infrared, acoustic, 
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radio frequency or other electromagnetic signals, etc.) to disp.ay screens 212, 214 and 
216 that are equipped with receivers 232, 234 and 236, respecttvely. 

Figs. 3A-B illustrate the use of mounting brackets for positioning a four-screen 

"hood" display. 

In Fig 3A four screens are held in place with two mounting brackets. Left 
anting bracket 250 attaches to screens 260, 262 and 268. Right mounting bracket 
252 attaches to screens 260, 264 and 268. The user viewpoint is as dep.cted for a 
viewer of Fig. 3A. 

Each bracket has three U-shaped slots far holding an edge of a screen. The 
slots can be Sited, or movably posttioned, so that the screens can tan. dMeren. angles 
in accordance with a users preference for a specie set of screen orientations. In a 
prefer^ embodiment a general configuration is maintained where ma,n screen 260 
has left and right screens 262 and 264; along w«h top screen 268. Details of the 
brackets are discussed in more detail, below. 

Each screen has a stand. In Fig. 3A. screen 260 is shown wrth stand 270 wh,le 
screen 268 is shown w«h stand 272. Note that screen 268 is upside down so that 
stand 272 is pointing towards the viewer. In a preferred embodiment, the system can 
flip a screen's image information so that an upside-down screen still displays a 
hghtside-up image. In genetal, the system of the present invention can acoommo ate 
s reens posfloned at offset rotational angles such as sideways, or any degree of fill 
An afiemative arrangement for screens is shown in Fig. 3B. Fig. 3B shows a 
ieft-side view of the hood configurate of Fig. 3A. In Fig. 3B, top screen 268 is now 
rightsi de-up so that stand 272 is pointed away from a viewer Some 
saeen arrangements may be more easily positioned if there ,s no. a stand. However 
Z o« toda/s flat pane, displays have stands M are no, removable, or 
to accommodate desired screen arrangements. Most likely the use o, stands for the 
main, left and right screens is desirable. 

Figs. 4A-C illustrate details of a mounting bracket for achieving a hood 

confiquration of 4 screens. 

in Fig . 4A, bracket 250 of Fig. 3A is show* shaded so that «s geometry can be 
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m ore easily seen. Other bracket 252 is not shown but. as discussed, operates 
analogous to bracket 250. The brackets are used to hold four screens together ,n a 
Lvablylorientabon. The .op screen can be .i,.ed up or down, 
screens can be an 9 led inward or outward wKh respect to the main screen. The 
brackets provide enough stiffness in their joints, or hinges, so that a user can manually 
m „ve the screens to a position and the posKion will be thereafter maintained. 

Note that the sevens of Fig. 4A indude borders. The border area is used as a 
region for providing width to the slots of the brackets. When screens have borders the 
material used to make the slots can be opague since none o. the screens' M area 
is obscured. Alternatively, slots can be made transparent where they overlap, or 
otherwise obscure, screen display areas. For example, where there is no screen 
border the slots should be transparent. 

Fig 4B shows a close-up of bracket 250 of Figs. 2A and 3A. 
in Fig 4B three slots 310, 312 and 314 make up the bracket, corresponding to 
top , main and ,e« slots. Bracket 302 is a mirror image o, bracket 300 so m U * 
main and right screens are accommodated. Slots 310 and 312 are ,o,ned by h, 320 
whi ch is viewed from its end in Ft 4B. Slots 312 and 314 are joined by h,nge 322 
which is viewed lengthwise. Each slot is U-shaped for receiving a display screen s 
edge (as shown in Fig. 4A). Naturally, slots can be made to be different shapes Any 
manner of shape is possibie and dfferent ways of movably coupling the slots « be 

apparent, as is known in the art. 

Slots include two sides, or arms, and a bottom. In a preferred embodiment, a 
siofs arms are no. necessarily the same length. For example, slot 310 has a front arm 

* need more supped a, » front face due to gravity. Other bracket arrangement a can 
have arms of any configurate length, size, shape, coloration or other atmbu.es or 
properties. 

Fig 4C illustrates an enlargement of the circled area, A, of F.g. 4B. 

In Fig 4C slots 310, 312 and 314 are joined as discussed, above. Hinge 320 

joins slots 310 and 312, while hinge 322 a joins slots 312 and 314. In a preferred 
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embodiment pointers are affixed to the hinges, or other parts of a bracket. The 
portions o. the hinges to whictr the pointers are affixed are also affixed to slot 312. 
which is the slot for the main screen. In this manner, the pointers can be used to 
indicate the angles of .he top and side screens with respect to the main screeh. Angle 
markings are printed onto slots 310 and 314 so ma. a human user can more eas V 
determine me angles .0 which .he screens and slots have been ad,us«ed. The angle 
men entered into a computer program for use by a presentation program, or other 
program, to determine the posttons of me screens as discussed, above. Other 
embodiment can use different methods of indicafing angles. For example, sensors 
such as a potentiometer, swtehes, etc., can be coupled to an input of a computer 
system to automatically indicate the angles. Any manner of angle measunng 

mechanism can be employed. 

Although the invention has been discussed primarily with respect to computer 
(or digital processor) presentations, aspects of the invention can be applied to other 
forms of presentafion. For example, optical presentations can be coordinated by 
sensing the posHions of screens according to the invention. Slides, film or other medra 
ca „ be projected onto rear-projecfion dispfcy screens according to the detected screen 
orientations to achieve a desired result, or goal The images can be designed to _ 
portray a scene. A uay of slide photographs can be selected according to whether the 
display screen is in an overhead, lateral, or ground posKion. For an overhead position, 
e g a blue sky, clouds, bird, etc. image is selected for display. Similady, a honzon. 
person, grass, roadway, etc.. image can be displayed according to pos*on. 

Even more basic types of presentations can be employed. For example, where 
ft. goal is to illuminate an object with certain colors, intensity, or shading of light the 
display screens may be used merely as sources of w* or tinted illumination Thus, 
the screen posifions can be sensed and compared to a desired lighting model that rs 
provided to a computer, or other system. The system can sense the positions and 
provide each screen wim information to create illumination to obtain the desired result. 
Such an approach is useful, for example, in photography, film or movemaking where 
typical lighting sources include key, fill and background lighting. Parameters such as 
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color balance, light temporal, etc. can be used to specBy the model for Hghtrng. 
Sophisticated, controllable, light sources can be substituted for the display screens. 
Light sources can include incandescent, fluorescent, tungsten, daylight reflectors, 
plasma screen, electron tubes, LCD, TFT, microminor or other devices. A 
■presentation program" can be any type of hardware or software mat generates images 

for viewing on multiple screens. 

Naturally any combination, position or oriental (e.g., rotated, angled, slanted, 
etc ) of display screens is possible. Also, any type of display device (or light source) 
can be used including cathode ray fcbes (CRTs), flat-panel displays (e.g., Iqdd crystal 
displays (LCDs), thin-film transistors (TFTs), etc.), plasma, electrofluorescent, 
project, glass, silvered screens, etc. Axry shape and s*e of display can be used 
including any size of standard rectangular displays, circular, curved, convex, concave, 
three dimensional (i.e., non-planar), etc. 

The presentation program need not display the same resoludon on all of the 
screens. In fact, it is more advantageous to detect where a user is viewing so that the 
focus point can be rendered in higher resolution while screen areas that the user . , not 
looking at directly can be rendered in lower resolution (o, not a, all). This approach 
reduces the processing resources needed by the presentation program and reduces 
bandwidth needed to transfer viewing information to the screens. 

The user's viewing director or viewpoint can be detected by position sensing, 
as described above. The user can wear an emitting indicator that assists ,n 
automatically detecting the viewing posihon. For example, the TracklfT system from 
NaturalPoinf" can be used. If it is known, for example, that the user is looking at the 
main screen then the top and side screens can be rendered in lower resoMon. Or 
regions on the screens, as opposed to the entirety of the screens, can be rendered 
differently. A rear screen or other screen, or screen portion, no. currency visible need 

not be rendered at all. . 

Although a specific type of bracket is described, variations can be obtained that 
are w«hin the scope of the inventor. For example, a bracket might use V-shaped" 
rather than U-shaped slots. Clamps can be used instead of the slots. Abracketthat 
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does no, use the rectangular sk*s of the preferred embodiment oan be emp^d 
Mferen. ways of hinging, or movab* connecting the slots together oan be employed. 
°„ld of Jo brackets, a single bracKe, can be formed by joining the brackets along 
one or more axes. For example, me brackets oan be joined horizontally along the 
adjacency of the main and top s^ns. It is posaib, separate brackets can * used 
so mat, instead of three slots joined together, on* two slots are joined. In ft. case, 
.he bracket may be posited a, dfleren. areas of .he screens. For example 
draoke, can be used atthe midpoint of each screen adjacency so that, e.g., the man 
and top screens are he* together, the left and main screens, and the ngh. and marn 
screens are each held by a separate bracket. 

Many varia«ons of bracked are possWe. ,„ gene* not necessary o have 
to. ang, measuring indicator o„he preferred embodiment. Brackets need no, be 
m0 veab te but can be manufactured w«h slots in a «xed, unmoveab, posrbo ■ Or a 
bracket can allow only a few positions, rather than the continuous pos*,on,ng that 
possible with the brackets discussed, herein. 

Thus, the scope of the invento is to be determined solely by are appended 



claims. 



